This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



Appl. No. 09/521,252 

Amdt. sent June 8, 2004 

Reply to Office Action of January 20, 2004 



PATENT 



Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings of claims in the application: 
Listing of Claims: 



1 1 . (Original): A method for managing information during a meeting 

2 comprising steps of: 

3 recording activities among participants during said meeting to produce recorded 

4 meeting data; 

5 identifying a participant directive by analyzing said recorded meeting data while 

6 said meeting is ongoing, said participant directive representing an action on said information 

7 desired by a participant of said meeting; and 

8 in response to identifying said participant directive, effectuating said participant 

9 directive, 

10 thereby facilitating the management of information during said meeting. 

1 2. (Original): The method of claim 1 wherein said identifying a participant 

2 directive includes producing textual information from said recorded meeting data and analyzing 

3 said textual information. 

1 3. (Original): The method of claim 2 wherein said recorded meeting data 

2 includes video recordings and audio recordings. 

1 4. (Original): The method of claim 1 wherein said action includes an activity 

2 selected from the group consisting of: document management activities, document editing 

3 activities, messaging functions, establishing communication with a new meeting participant, and 

4 manipulation of said recorded meeting data. 

1 5. (Original): The method of claim 4 wherein said document management 

2 activity includes accessing said recorded meeting data during said meeting. 
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*1 6. (Original): The method of claim 1 wherein said activities include verbal 

2 communication, written communication, presentation of prepared material using a projection 

3 system. 

1 7. (Original): The method of claim 1 further including ascertaining identities 

2 of said participants and selectively effectuating said participant directive based on said identities. 

1 8. (Original): The method of claim 1 further including tracking locations of 

2 said participants and selectively effectuating said participant directive based on said locations. 

1 9. (Original): The method of claim 1 further including locating said 

2 participants in different geographic locations. 

1 10. (Original): A method for providing information services during a meeting 

2 involving two or more participants comprising steps of: 

3 producing a continuous video recording of at least one of said participants for the 

4 duration of said meeting; 

5 producing a continuous audio recording of at least one of said participants for the 

6 duration of said meeting; 

7 storing said video and said audio recordings in a data store; 

8 detecting a participant directive based on either or both of said video recording 

9 and said audio recording; and 

10 providing one or more information-related services based on said participant 

1 1 directive, 

12 thereby providing information-related services based on gestures and vocal 

13 utterances made by said participants during said meeting. 

1 11. (Original): The method of claim 1 0 wherein said detecting a participant 

2 directive includes receiving participant input from an input device. 
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1 12. (Original): The method of claim 10 wherein said detecting a participant 

2 directive includes analyzing textual information contained in either or both of said audio and 

3 video recordings. 

1 13. (Original): The method apparatus system of claim 10 wherein said 

2 detecting a participant directive is based on the context of the meeting. 

1 14. (Original): The method of claim 10 wherein said detecting a participant 

2 directive includes detecting an information retrieval cue, said method further including: 

3 producing certain information based on said information retrieval cue, including accessing said 

4 data store to retrieve one or more segments of said video and said audio recordings and accessing 

5 one or more databases to retrieve information contained therein; and presenting said certain 

6 information to one or more of said participants. 

1 15. (Original): The method of claim 14 wherein said detecting an information 

2 retrieval cue includes receiving participant input from an input device. 

1 16. (Original): The method of claim 14 wherein said presenting certain 

2 information is a step of presenting said certain information to less than all of said participants. 

1 17. (Original): The method of claim 14 further including tracking locations of 

2 said participants, wherein said presenting said certain information is a step of selectively 

3 presenting said certain information based on said locations. 

1 18. (Original): The method of claim 10 wherein said information services 

2 include accessing information, editing information, assimilating information to produce new 

3 information, establishing communication with a new participant, transmitting and receiving 

4 messages, accessing a global information network, and accessing a local network. 

1 19. (Original): The method of claim 18 wherein said messages include 

2 electronic mail. 
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1 20. (Original): The method of claim 10 wherein provision of said 

2 information services depends on permissions associated with said participants. 

1 21. (Original): The method of claim 20 further including identifying said 

2 participants to determine associated permissions. 

1 22. (Original): The method of claim 10 further including locating said 

2 participants in geographically distinct locations. 

1 23. (Original): A system for providing information services during an 

2 interaction between two or more participants, comprising: 

3 a video capture component configured to produce a continuous video recording of 

4 at least one of said participants; 

5 an audio capture component configured to produce a continuous audio recording 

6 of at least one of said participants; 

7 a data storage component containing information, said data storage component in 

8 communication with said video and audio capture components and configured to store said video 

9 and audio recordings; 

10 a detection component in communication with said video and audio capture 

1 1 components and configured to detect a participant directive by analyzing either or both of said 

12 video and audio recordings; and 

1 3 a service provision component in communication with said data storage 

14 component and configured to provide an information service based on said participant directive, 

1 5 thereby providing information services during said interaction based on gestures 

1 6 and vocal utterances made by said participants. 

1 24. (Original): The system of claim 23 wherein said participant directive is an 

2 information retrieval cue, and wherein said service provision component is further configured to 

3 retrieve certain information from said data storage component in response to said information 

4 retrieval cue and to provide said certain information to said display component. 
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1 25. (Original): The system of claim 24 wherein said certain information 

2 includes said continuous video recording and said continuous audio recording. 

1 26. (Original): The system of claim 23 further including a user input portion 

2 configured to receive user-provided input data, said detection component further configured to 

3 identify a participant directive from said user-provided input data. 

1 27. (Original): The system of claim 23 further including a participant 

2 identification component, said service provision component being further configured to 

3 selectively provide said information service based on identities of one or more of said 

4 participants. 

1 28. (Original): The system of claim 27 wherein said identities have associated 

2 permissions, said service provision component being further configured to selectively provide 

3 said information service based on said permissions. 

1 29. (Original): The system of claim 27 wherein said participant identification 

2 component is configured to provide participant locations, said service provision component 

3 being further configured to selectively provide said information service based on said participant 

4 locations. 

1 30. (Original): The system of claim 23 wherein said information service 

2 includes providing access functions over a communication network. 

1 31. (Original): The system of claim 30 wherein said information service 

2 includes data retrieval from a global communication network. 

1 32. (Original): The system of claim 30 wherein said information service 

2 includes data retrieval from a plurality of web sites. 
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1 33. (Original): A method of utilizing plural information sources to enhance 

2 information management during a meeting between two or more attendees, comprising: 

3 producing and storing a continuous audio-visual recording of one or more of said 

4 attendees, said audio-visual recording comprising a video data component and an audio data 

5 component; 

6 extracting and storing textual information from said audio and video data 

7 components; 

8 extracting and storing image information from said video data component; 

9 detecting attendee action cues from said audio and video data component 

10 including analyzing said textual and said image information; 

1 1 accessing certain information from said information sources based on said 

12 attendee action cues; and 

13 presenting said certain information, 

14 thereby providing information services during said meeting on the basis of the 

15 actions of said attendees. 

1 34. (Original): The method of claim 33 wherein said accessing certain 

2 information includes searching through said audio-visual recording. 

1 35. (Original): The method of claim 33 wherein said detecting attendee action 

2 cues includes receiving explicit commands from an attendee. 

1 36. (Original): The method of claim 33 further including tracking locations of 

2 said attendees, said presenting certain information being based on said locations. 

1 37. (Original): The method of claim 33 further including editing information 

2 in said information sources based on said attendee action cues; and producing new information 

3 by assimilating portions of information in said information sources based on said attendee action 

4 cues. 
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1 38. (Original): The method of claim 33 further includes identifying said 

2 attendees from said audio and video data components to produce attendee identifiers. 

1 39. (Original): The method of claim 38 further including manipulating 

2 information in said information sources based on said attendee action cues and said attendee 

3 identifiers. 

1 40. (Original): The method of claim 39 wherein said manipulating 

2 information includes editing said information. 

1 41. (Original): The method of claim 33 further including locating said 

2 attendees in different parts of the world. 

1 42. (Original): A system to facilitate the management of information during a 

2 meeting between two or more attendees, comprising: 

3 an information storage portion configured to receive and store information and to 

4 access and provide information; 

5 an audio-visual capture portion in communication with said information storage 

6 portion and configured to produce real-time video recordings and real-time audio recordings of 

7 one or more of said attendees; 

8 a text classification portion in communication with said information storage 

9 portion and configured to produce and store textual information extracted from said audio and 

10 video recordings ; 

1 1 an image classification portion in communication with said information storage 

12 portion and configured to produce and store image information in said video recordings; 

13 a cue detection portion configured to detect attendee action cues from said textual 

14 information during said meeting; 

15 an information retrieval portion in communication with said information storage 

16 portion and configured to access information therefrom based on said attendee action cues; 
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17 an information manipulation portion in communication with said information 

1 8 storage portion and configured to manipulate information stored therein based on said attendee 

19 action cues; and ' 

20 an information presentation portion operatively coupled to said information 

21 retrieval portion and said information manipulation portion and configured to display retrieved 

22 and manipulated information, 

23 wherein information including said textual information and said image 

24 information can be retrieved and manipulated by gestures and voice input of said attendees 

25 during said meeting. 

1 43. (Original): The system of claim 42 further including an attendee 

2 identification portion coupled to said information storage portion and configured to identify said 

3 attendees from said audio and video recordings and to provide attendee identifiers. 

1 44. (Original): The system of claim 43 wherein said information presentation 

2 portion is further configured to selectively display said retrieved and manipulated information to 

3 attendees depending on said attendee identifiers. 

1 45. (Original): The system of claim 42 wherein said attendee action cues 

2 include directives to access said video and audio recordings of said meeting. 

1 46. (Original): The system of claim 42 wherein said cue detection portion is 

2 further configured to detect said attendee action cues on the basis of the context of said meeting. 

1 47. (Original): The system of claim 42 further including an attendee tracking 

2 portion configured to track movements and locations of said attendees. 

1 48. (Original): The system of claim 47 wherein said information presentation 

2 portion is further configured to selectively display said retrieved and manipulated information to 

3 attendees depending on said attendee identifiers, said attendee cues, and said locations of 

4 attendees. 
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"1 49. (Original): The system of claim 47 wherein said attendee identification 

2 portion includes creating new identifiers for unknown attendees. 
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